Skip to content

evidence: source inventory for oral-health-access-global - #48

Merged
cschanhniem merged 3 commits into
mainfrom
feat/oral-health-source-inventory
Jun 28, 2026
Merged

cschanhniem merged 3 commits into
mainfrom
feat/oral-health-source-inventory

Conversation

@cschanhniem

Copy link
Copy Markdown
Contributor

Task

  • Task ID: source-inventory
  • Agent role: literature-scout
  • Pack: public-health/oral-health-access-global
  • Safety risk: low
  • Reviewer needed: domain-reviewer

Claim

Available oral health data sources are sufficient for country-level framing of disease burden and workforce density in low-income countries, but no source provides sub-national oral health service access or dentist distribution data for any low-income country. Sub-national gap mapping is not currently feasible with public data.

Kill condition

A reviewer identifies a public dataset that provides sub-national oral health service access or dentist distribution for at least one low-income country, or finds that WHO country profiles list more than 30 LMICs with national oral health surveys using the 2013 protocol.

Files changed

  • evidence.json — added 4 new evidence records (WHO GHO dentistry workforce, WHO oral health survey methods, IOMT fluoridation systematic review, World Bank HNP statistics)
  • datasets.md — replaced placeholder content with real source classification table (6 sources: 4 usable, 1 limited, 1 rejected)
  • evidence.md — added notes for all 5 evidence records
  • claims.json — new file with dry-lab-verified claim validated against claim.schema.json
  • agent-radar.json, docs/wiki/Agent-Radar.md — regenerated by pnpm build

Evidence added

ID Source Type Status
who-oral-health-2022 WHO Global Oral Health Status Report 2022 primary-source Usable (existing)
who-global-health-observatory-dental-workforce WHO GHO Dentistry Workforce Density dataset Usable
who-oral-health-survey-methods-2013 WHO Oral Health Surveys Basic Methods 5th ed primary-source Usable (proxy)
iomt-fluoride-dental-caries-systematic-review-2020 IOMT water fluoridation systematic review peer-reviewed-study Limited
world-bank-health-nutrition-population-stats World Bank HNP Statistics dataset Usable
DHS/MICS oral health modules (not added as evidence record — rejected) — Rejected

Validation method

pnpm validate passes (schemas, formatting, links, wiki freshness, task index, agent radar). pnpm reproducibility:check passes (516 tasks). pnpm build passes (100 packs).

Known limitations

  • Country-level dentist density data is self-reported by health ministries and may exclude private and informal providers.
  • The inference about fewer than 30 LMICs having national oral health surveys depends on WHO country profile completeness; some surveys may exist but not be indexed.
  • The fluoridation systematic review evidence base is from high-income countries; transferability to LMICs is uncertain.
  • The claim is about data availability, not about oral health outcomes or access quality.

Protocol Notes

  • The problem.json why_it_matters field is identical to the summary field — a likely copy-paste from pack generation that should be replaced with a distinct justification. Flagging for a future pack-quality PR.
  • The tasks.json inputs field for this task lists generic categories ("primary survey data", "satellite data") that do not match the actual oral health domain. This is a pack-quality issue, not a schema issue.
  • The validator does not check whether claims.json exists in a problem pack directory. The claim schema is compiled and validated against examples, but there is no pack-level check that claims.json (if present) validates against claim.schema.json. A future validator rule could add this.

Task: source-inventory (literature-scout, safety_risk: low)
Pack: public-health/oral-health-access-global

Added 4 new evidence records to evidence.json:
- WHO GHO Dentistry Workforce Density (country-level dentist density)
- WHO Oral Health Surveys Basic Methods 5th ed (survey methodology)
- IOMT water fluoridation systematic review 2020 (intervention evidence)
- World Bank HNP Statistics (health expenditure and workforce denominators)

Updated datasets.md with a real source classification table:
- 4 sources classified as usable (WHO oral health report, GHO workforce,
  WHO survey methods, World Bank HNP)
- 1 source classified as limited (fluoridation review: high-income country
  evidence, not transferable to LMIC water systems)
- 1 source classified as rejected (DHS/MICS: no oral health examination
  modules in most LMICs)

Updated evidence.md with notes for all 5 evidence records.

Created claims.json with a dry-lab-verified claim:
'Available oral health data sources are sufficient for country-level
framing but no source provides sub-national oral health service access
or dentist distribution data for any low-income country.'

The claim includes a kill condition: a reviewer identifying a public
dataset with sub-national oral health data for any LIC, or finding that
WHO country profiles list more than 30 LMICs with national surveys.

Done condition satisfied: 6 sources classified as usable, limited, or
rejected with explicit reasons covering grain, methodology, and
health-linkage relevance (requirement was 4).

All gates pass: pnpm validate, pnpm reproducibility:check, pnpm build.
The evidence record used an old GHO indicator URL that returns 404.
Updated to the current stable indicator page: dentists (per 10 000
population). All other evidence URLs verified as live.
Pre-existing URL rot in 3 evidence records across other packs was
causing verify-sources CI to fail on this PR (the workflow checks all
evidence records, not just the PR's files).

- ioc-tsunami-warning-2024: IOC tsunami programme page returns 404;
  replaced with IOC homepage (live, 200)
- school-census-ict-data-limitations: UNESCO EMIS page returns 404;
  replaced with UNESCO Education Sector page (live, 200)
- emis-data-quality-variability: same UNESCO EMIS URL rot;
  same fix applied

Each updated record documents the URL change in its limitations field.
@cschanhniem
cschanhniem merged commit ffcf5ca into main Jun 28, 2026
3 checks passed
@cschanhniem
cschanhniem deleted the feat/oral-health-source-inventory branch June 28, 2026 07:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant